® 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




© Publication number: 



0 689 1 32 A2 



© 



EUROPEAN PATENT APPLICATION 



© Application number: 95107866.6 
© Date of filing: 23.05.95 



© int. ci. 6 : G06F 9/44 



@> Priority: 23.06.94 US 264663 

@ Date of publication of application: 
27.12.95 Bulletin 95/52 

© Designated Contracting States: 
DE FR GB 

© Applicant: International Business Machines 
Corporation 
Old Orchard Road 
Armonk, N.Y. 10504 (US) 

© Inventor: Laffra, Johannes Christiaan 
319 Croton Dam Road 



Ossining, 

New York 10562 (US) 
Inventor: Malhotra, Ashok 
212 Hessian Hills Road 
Croton-on-Hudson, 
New York 10520 (US) 



© Representative: Schafer, Wolfgang, Dipl.-lng. 
et al 

IBM Deutschland 
Informationssysteme GmbH 
Patentwesen und Urheberrecht 
D-70548 Stuttgart (DE) 



© Visualizing object-oriented software 



CM 
< 

CM 
CO 

o> 

00 
CO 



© Object-oriented system methods are automati- 
cally instrumented with method hooks that are ca- 
pable of generating graphical information that can be 
visualized on a graphical interface. When a method 
hook is run, it can indicate the occurrence of: an 
object instance being created, and object instance 
being destroyed, an method being entered or a 
method being exited. In the event of one of these 
occurrences, the method hooks initiate execution of 
a monitoring function that uses the graphical in- 
formation and a visualization script with rules to 
update a visualization shown on the graphical inter- 
face. The update will conform with the current state 
of the object instances visualized. The rules can be 
changed, to modify the visualization, without recom- 
piling or relinking the application programs. Con- 
straints also can be used by the monitoring function 
to modify the visualization. 
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FIELD OF THE INVENTION 

This invention relates to the field of visualizing 
the execution of software systems with particular 
emphasis on visualizing object-oriented software. 

BACKGROUND OF THE INVENTION 

In the area of computer programming, it is 
often desirable to be able to visualize the execution 
of a computer program on a graphical interface. 
The visual display presented on the interface is 
sometimes used to show a user the workings of 
algorithms for the purpose of exposition or under- 
standing. Visualization of the execution of object 
oriented systems has been discussed to some 
degree in the prior art. Typically these visualization 
systems address the following questions: 

• How does the user select which aspects of 
the program state of the object-oriented sys- 
tem should be visualized? 

• How should each of the selected aspects be 
represented? 

• When should the selected aspects be dis- 
played? 

• When should the display be refreshed? 
Balsa (IEEE Computer, Vol. 21, No. 5, May 

1988, pp.1 4-36) discloses procedure calls that are 
added to capture significant events in the program. 
Each event is distributed to one or more visualiza- 
tion processes which create and update the graphi- 
cal displays that constitute the visualization. How- 
ever, this is an essentially manual process. Special 
code has to be a written by hand and compiled 
and linked with the application to create the visu- 
alization. If the purpose of the visualization is de- 
bugging, then the code has to be removed after the 
bugs are found and corrected: a process that may 
lead to other bugs. 

TANGO (IEEE Computer, Vol. 23, No. 9, Sept. 
1990, pp.27-39) discloses a number of object 
classes such as locations, images, paths and tran- 
sitions that can be used to specify the events as 
well as the visualizations. However, the process, 
still remains essentially manual although the 
predefined objects simplify the process to some 
extent. 

OBJECTS OF THE INVENTION 

An object of this invention is an improved sys- 
tem and method that allows a user to simply and 
easily create a customized visualization for an ob- 
ject-oriented software system. 

Another object of this invention is an improved 
system and method for customizing the visualiza- 
tion of object-oriented software executing on a 
computer for the purposes of program design, de- 
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bugging, and inspection as well as for teaching and 
learning. 

SUMMARY OF THE INVENTION 

5 

The present invention is an efficient system , 
and method for visualizing the internal workings of 
object-oriented software. 

An object-oriented system has application pro- 

10 grams that have one or more object classes. Each 
of these object classes has one or or more object 
instances with variables. The variables have values 
that define the state of the object instance. The 
object classes also have methods that can change 

75 the state of an instance by changing the variable 
values. 

These methods are instrumented with method 
hooks that are capable of generating graphical in- 
formation that can be visualized on a graphical 

20 interface. The method hooks are novelly added by 
an automatic technique. When a method hook is 
run, it can indicate the occurrence of: an object 
instance being created, an object instance being 
destroyed, a method being entered or a method 

25 being exited. In the event of one of these occur- 
rences, the method hooks initiate execution of a 
monitoring function that uses the graphical informa- 
tion and a visualization script with one or more 
rules to update a visualization shown on the graphi- 

30 cal interface. The update will conform to the cur- 
rent state of the object instances visualized. The 
rules can be changed, to modify the visualization, 
without recompiling or relinking the application pro- 
grams or without any manual changes to the 

35 source code. Constraints also can be used by the 
monitoring function to modify the visualization. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 Figure 1 is a block diagram of a computer 
system executing the present in- 
vention. 

Figure 2 is a diagram showing how one or 
more object classes are modified to 
45 create the novel structures of the 

present invention. 
Figure 3 is a flow chart of the steps of the 

present method. 
Figure 4 is a flow chart of the steps of relat- 
50 ing object instances with displayed 

views. 

Figure 5 is a drawing of a display generated 
by the visualization script. 

55 DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 is a block diagram showing a com- 
puter system 100 on which a preferred embodi- 

2 
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ment of the present invention operates. The pre- 
ferred embodiment includes one or more applica- 
tion programs 102. One type of application pro- 
gram 102 is a compiler 105 which includes an 
optimizer 106. The compiler 105 and optimizer 106 
are configured to transform a source (like other 
application programs 102) program into optimized 
executable code. More generally, the source pro- 
gram is transformed to an optimized form and then 
into executable code. The compiler 105 and opti- 
mizer 106 operate on a computer platform 104 that 
includes a hardware unit 112. The hardware unit 
112 includes one or more central processing units 
(CPU) 116, a random access memory (RAM) 114, 
and an input/output interface 118. Micro-instruction 
code 110, for instance a reduced instruction set, 
may also be included on the platform 104. Various 
peripheral components may be connected to the 
computer platform 104 including a graphical dis- 
play terminal 126, a data storage device 130, and a 
printing device 134. An operating system 108 co- 
ordinates the operation of the various components 
of the computer system 100. An example of com- 
puter system 100 like this is the IBM RISC Sys- 
tem/6000 (RISC System/6000 is a trademark of the 
IBM Corporation.) It is readily understood that 
those skilled in the computer arts will be familiar 
with many equivalent computer systems 100 that 
are within the contemplation of this invention. 

The invention specifically pertains to object- 
oriented systems. Thus, one or more of the ap- 
plication programs 102 would be object-oriented 
applications. The compiler 105 and the optimizers 
106 would have the capability to process an object- 
oriented computer language, e.g., C + + or Small- 
talk. Object- oriented systems are well known in 
the art. 

Figure 2 is a block diagram showing the struc- 
ture of one or more objects in an object-oriented 
system and how they are modified to create a 
structure that is used in the present invention. 

An object class 200 typically has a plurality of 
object instances, typically 205. Each object in- 
stance 205 comprises one or more variables 210. 
The set of variables 210 in the instance is defined 
as the state 220 of the object instance. The in- 
stances 205 in the class have the same variable 
definition (i.e., variable type and number) but the 
variables in each instance can have different values 
at run time. 

Therefore, the state of a given instance is also 
defined at run time by the actual values of its 
instance variables. 

An object class 200 further contains one or 
more methods 230 that can operate on each in- 
stance that resides in the object class. A method 
230 is a collection of executable statements that 
may change the state of the instance 205 in the 



class 200 for which the method 230 is executed. 
Therefore, at run-time a method changes the state 
of an instance by changing the value of the one or 
more of the instance variables in the instance vari- 

5 able set 210 defining the state of the instance. 

The methods of any object class can be called 
to execute in many ways. These include calls by 
other methods 230 in the same object class 200, 
calls from instances 205 in other object classes 

10 200, and/or call sites outside the object-oriented 
system. In other words, the methods 230 can be 
called using any known prior art procedure. 

To further illustrate, a typical object class might 
be called Employee 200. The object class Em- 

75 ployee 200 might represent information about all 
employees in a company. The plurality of instances 
205 would be a set of records about individual 
employees and could include a first instance 204 
through a last instance 206. Each instance consists 

20 of a set of instance variables 210 (also called 
members or attributes 210) with given values. The 
values describe the particular employee associated 
with the instance. For example, the variables name 
and employee number and salary might be the set 

25 of variables 210 of the instance and therefore 
would also define the state 220 of the instance 
describing a given employee. 

The object-oriented structures described above 
are well known. 

30 In the present invention, a parser 240 initially 

"reads" the definition of the methods of one or 
more of the object classes 200 in the object-ori- 
ented system in order to determine where to novel- 
ly insert method hook (260 and 270) data struc- 

35 tures. In a preferred embodiment, the parser 240 
reads the source code of the object class definition 
(i.e., the source code of the definitions of variables 
and methods), to be able to find locations in the 
source code to insert method hooks (260 and 270). 

40 The parser 240 analyzes the source code by first 
determining the beginning and the end of the each 
method by using indications in the method syntax, 
e.g., by recognizing a beginning and an end de- 
limiter on each method. Typically, these delimiters 

45 are object-oriented language dependent, e.g., in 
C+ + the delimiters used are "{" and "}". Other 
indications (delimiters) might be used in different 
object-oriented languages. Alternative, the parser 
240 can place method hooks only at the start of the 

so method 260. 

For example, in the object-oriented language 
C+ + , a method hook can be created by inserting 
a declaration of a variable on the stack. This vari- 
able is created when the enclosed body of C + + 

55 code (i.e., the method 230) is executed, and de- 
leted when the method terminates. The variable is 
of a special type, so that when the variable is 
created, a special piece of code (called "construc- 
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tor" in C++) will be executed (which will form 
hook 260). In addition, special code will be ex- 
ecuted when the variable is deleted again (called 
the "destructor" in C++). Therefore, the creation 
and deletion of the variable will be done each time 
the method is run. Another preferred way of insert- 
ing hooks after compilation is described below. 

The hooks take the form of executable code 
that is used to pass information to a monitoring 
function (see Figure 3). The information is passed 
each time an instance of an object class of interest 
in an object-oriented application program is created 
or deleted and each time a method in the object 
class of interest is entered or left. An object class 
of interest is a class into which hooks have been 
inserted. 

In addition, there may be certain conditions 
placed on the passing of this information. For ex- 
ample, calls from can be collected in a buffer and 
to be handled together after a certain number is 
selected. 

An example C+ + class definition with three 
instance variables and one method could like like: 

1. class Employee { 

2. char "name; 

3. int employee number; 

4. float salary; 

5. void RaiseSalary(int); 

6. }; 

7. void Employee::RaiseSalary(float 
new__salary) 

8- { 

9. salary = new_salary; 

10. } 

When instrumented with parser 240 the definition 
of the method 230 defined at lines 7 to 10 could be 
modified into: 

7. void Employee::RaiseSalary(float 

new salary) 

8. { 

8a. _SPECIAL_HOOK_TYPE_hook(this, "Em- 

ployee::RaiseSalary", 

8b. new salary); 

9. salary = new salary; 

10. } 

The code on lines 8a and 8b form the hook code 
for method 230. Each time the method RaiseSalary 
is called on an instance of type Employee , its 
salary will be updated and the statement on lines 
8a and 8b is executed, which is a declaration of a 
variable on the stack. As describe above, the ex- 
ecution of this statement will result in a call to the 
monitoring function (described in Figure 3), both 
when the method is entered and when it is left. 
This is how hooks can be inserted in a C + + 
program, to detect the execution of methods 230. 
When executed these methods can manipulate in- 
stances, i.e., make modifications to their variables 



210. 

In another preferred embodiment using C++, 
the parser 240 can also place hooks in the con- 
structor and destructor of a given class. The con- 
5 structor and destructor are special C+ + methods - 
which are executed when an instance of that class . 
is created and deleted again. Thereby, the method 
hooks 260 and 270 in the constructor and destruc- 
tor indicate when instances are being created and 
w deleted. If either the constructor or destructor are 
not defined in the class definition, the parser 240 
can generate the constructor and destructor with an 
inserted method hook(s). 

While parsing the class definition, the parser 
75 240 can also generate run time type facilities, al- 
lowing the instance variables of an object instance 
to be inspected and/or modified at runtime. 

The parser can operate on one or more object 
classes in the object-oriented system. The selec- 
20 tion of which classes will be instrumented (the ones 
which will have hooks inserted) is left to the user. 
Only classes that are instrumented can be visual- 
ized in the graphical interface 126 at run time. 

After inserting, the hooks 260 and 270 the 
25 instrumented code will be compiled and linked 280 
using techniques well known in the art. 

In some systems, the instrumentation can be 
done after compilation 280, whereby the instrumen- 
tation is done directly on executable" code. This is 
30 done by patching the executable code, by finding 
in the executable code the beginning and end of a 
given method, and by inserting the executable ver- 
sions of hooks 260 and 270 respectively, directly in 
the executable code. In this process, the parser 
35 240 will be a parser which will work on the execut- 
able code. Furthermore, existing compilers for ob- 
ject-oriented programming languages can be en- 
hanced to generate the hooks 260 and 270 directly 
for the purpose of this invention. 
40 In yet other preferred embodiments, the execu- 

tion of class methods may be done in an interpre- 
tive mode, by using well known techniques. In that 
case the hooks 260 and 270 may be executed from 
within the interpreter. This can be the case for 
45 object-oriented languages such as Smalltalk. This 
process will eliminate the need for the parser 240. 

Parser 240 will novelly instrument an object 
class 200, to create a structure(s) 250, forming the 
original class definition together with the inserted 
so hooks 260 and 270, as described above. In this 
way, the object class is instrumented without any 
manual effort. 

Before the executable code 290 is run, a novel 
visualization script 285 is prepared by the user, 
55 and used by executable code 290. The script 285 
will tell the monitoring function (Figure 3) how to 
interpret the information which is generated by the 
hooks 260 and 270. The visualization script inter- 
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pretation process is described in Figure 4. 

The visualization script 285 is a collection of 
rules 288 in readable source code of a novel form. 
The visualization script 285 identifies one or more 
object classes and specifies how to display in- 
stances of those object classes on the display 126. 
This specification is done using the visualization 
script rules 288. (See also Figure 4, blocks 410 to 
450.) For example, if the visualization shown on the 
graphical display shows the salaries of all the em- 
ployees of a given department, the visualization 
script might contain rules to display salaries of 
individual employees as one bar in a bar graph. 
This could be done by having one rule create a 
window with a title "Employee Salaries." Another 
rule would create one bar for one employee (object 
instance) where the height of the bar is a function 
of salary. Another rule (or the same rule) might 
color the bar red if the employee's salary is higher 
than the manager's. Therefore, a set of rules like 
this for each employee instance would create a bar 
graph of salaries for each employee (instance) in 
the department. Note that the visualization script is 
passive. It is merely a specification that is selec- 
tively run by the monitoring function. 

Figure 3 is a flow chart of one preferred em- 
bodiment of a monitoring function 300 used by the 
present invention. The monitoring function receives 
information generated by hooks 260 and 270, when 
they are executed at runtime. The information that 
is gathered by the monitoring function is then visu- 
alized on a graphics display, guided by the set of 
rules 288, to be found in the visualization script 
285. Each time a particular hook is executed, the 
monitoring function 300 wilt inspect the current 
display and the script. The monitoring function 300 
then modifies the display depending on the hook 
and the visualization script. As described before, 
the hook 260 or 270 can notify the creation or 
deletion of an object instance; of the entrance or 
leaving of a particular method, executed on an 
instance. Depending on the nature of the hook, 
different actions may be taken by the monitoring 
function. If the hook notifies creation or deletion of 
an instance, the visualization script 285 will be 
used to generate or remove a visual representation 
of the instance on the display. If the hook notifies 
the execution of a method, the display may need to 
be updated, when the representations of objects 
created in the past no longer correctly visualize the 
state of their corresponding instances. Namely, 
during the execution of one or more methods, the 
state of an instance may have been updated, and if 
a representation of the object is available on the 
graphics display, it may need to be redrawn to 
reflect this state change- 
After a method hook (260, 270) is executed 
indicating that a method has been entered or ex- 



ited or that an object instance has been created or 
deleted, the monitoring function 300 is run. The 
monitoring function selectively evaluates part or ail 
of the visualization script (described in Figure 4) to 

5 determine how to build and/or modify a display of 
the visualization of the object-oriented system on 
the graphical interface 126. The monitoring function 
300 performs several tasks determined by the rules 
288 in the visualization script. These tasks include: 

10 1. determining if the changes made by the con- 
ditions causing the monitoring function to run are to 
be visualized, 2. determine how the visualization is 
to be modified, 3. modifying the visualization using 
the visualization script, and 4. enhancing the modi- 

15 fications if certain constraints are met. 

In step 310, the monitoring function 300 is 
executed when an executable version of one of the 
method hooks 260 or 270 is run at runtime. 

In step 320 the monitoring function determines 

20 if the changes caused by entering or exiting a 
method or the creation or deletion of an object 
instance causes a change in any object instance 
that is to be visualized. That is the case when 
object instances are currently represented on the 

25 graphics display, and their current state is no long- 
er correctly reflected in the visualization. In a pre- 
ferred embodiment, the monitoring function uses a 
visualization script 285. The visualization script de- 
fines rules 288 for the representations of object 

30 instances on the graphical interface. If the monitor- 
ing function 300 is called by a method hook in an 
object class that is referenced in the visualization 
script, that object class might be displayed or may 
need to be modified on the graphical interface 126 

35 at run time. Whether or not object classes are to 
be displayed on the graphics display is determined 
by providing visualization rules 288 in the appro- 
priate visualization script 285. Exchanging a given 
visualization script with different rules may produce 

40 a different visualization of the object-oriented pro- 
gram, without the need of recompilation or relinking 
of the source code. 

If the method hook will not result in a change 
of the graphics display, the monitoring function 

45 jumps to step 395, and returns. 

If the activated hook notifies the creation of a 
new object instance, the next step 330 wilt check to 
see if the visualization script has rules for the 
visualization for this object instance. If that is not 

so the case, the monitoring function 300 skips to the 
next step 350. If the script does have rules for 
visualizing this newly created instance, the script is 
used to actually generate the required visualiza- 
tions 340. For example, by using a given rule 288, 

55 an object instance of class Employee may be 
represented as a rectangle, where the height of the 
box is a function of the salary of the employee. In 
addition, by using another rule 288, a text label 
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may be generated close to the rectangle, to display 
the name of this employee. Now, each time an 
object of the class Employee is created, a hook is 
executed in the constructor for its type, the moni- 
toring function 300 is notified, and the visualization 
script 285 is used to find the two rules to visualize 
the given employee- After visualizing the employ- 
ee, the display may need to be updated at a later 
stage, if for instance, the salary of the employee 
gets updated. That will happen in step 320. In this 
example, the box representing the salary of the 
employee will need to be updated. If the name of 
the employee stays the same, the label need not 
be redrawn. 

If the activated method 300 notifies the deletion 
of an existing object instance, and a visualization 
for this instance has been generated in the past, 
step 330 will delete the visualization for this object 
instance. If this is not the case, the monitoring 
function skips to the next step 350. In the Em- 
ployee example, both the rectangle and the label 
need to be removed from the graphics display. 

Step 350 checks whether method triggers have 
been activated. The visualization script 285 can 
contain special rules 288, that can specify the 
user's interest in the execution of a given method 
(see also 450 in Figure 4). The method trigger rule 
identifies a class name, a method name, and 
whether the user is interested in entering this meth- 
od (corresponding with hook 260) or leaving this 
method (hook 270). If the script contains a rule that 
matches the activation of the hook 310, the activa- 
tion code for the trigger is executed in 360 (using 
the appropriate rules 288 in the visualization script 
285). If the script does not contain one or more 
rules that match the currently activated hook, the 
monitoring function 300 skips to step 370. Method 
triggers can be used to, for instance, count the 
number of times a given method is executed, and 
to update the display when a certain threshold has 
been reached. Furthermore, method triggers can 
be used, for example, to change the display when 
a given method is entered, for instance by coloring 
a visual item red, and to reset the display when the 
method is left again, for instance by coloring the 
visual item back to green. 

At step 370, the monitoring function resolves 
the set of constraints possibly defined by the script 
(see 440 in Figure 4). The resolution of the con- 
straint rules may result in updates to visualization 
variables, thereby influencing the display. If no 
constraints are defined, step 370 will have no ef- 
fect. 

At step 380, the display will actually be up- 
dated. Each visual representation that has been 
created in the past, during the execution of the 
monitoring function, and that is still active, will be 
checked. The set of one or more visualization rules 



288 for any given object instance is re-examined, 
and each of the parameters for the representation 
is recomputed, using the script 285. The value for 
each of the parameters of the visual representation 

5 can be a function of one or more visualization 
variables (possibly updated by method triggers or 
constraints). Alternatively, the value of a parameter 
can be a function of one or more instance variables 
of the instance that this visual representation is 

w linked to. When 380 detects that a visual repre- 
sentation will differ from a previous computation, it 
will be redrawn in 390. 

In a preferred embodiment, various optimiz- 
ations to process 380 can be envisioned. The visu- 

75 alization script can be transformed into an internal 
datastructure, facilitating faster comparisons be- 
tween specification and actual values. Furthermore, 
the display can be updated at a different rate (to 
collect a number of changes into one). In addition, 

20 well known techniques in computer graphics and 
animation, such as double buffering, morphing, and 
smoothing can be used to change the transition of 
one representation to another. 

Figure 4 shows the possible actions that can 

25 be taken according to syntactical elements avail- 
able in the visualization script language. First, in 
410, one or more global entities for defining the 
visualization shown on the graphical interface 126 
can be generated. The rules for the entities are 

30 executed whenever the script becomes active, and 
are deleted when the script becomes inactive. 
Typically, the script becomes active when the in- 
strumented program is activated, and inactive when 
the program stops. The global entities created in 

35 410 are given a name. They have a type, either 
basic types well known in general programming 
languages (including, but not limited to, integer, 
character, and string), or from a set of visual ele- 
ments (including, but not limited to, window, rectan- 

40 gle, circle, and text). Elements of a basic type are 
initialized with an initial value from the domain of 
the type of the element. Elements of a visual type 
are defined by a set of one or more parameters. 
The value for each parameter is given by an ex- 

45 pression using well known functional operators (in- 
cluding, but not limited to * + \ and "'), referring 
a combination of one or more constant values 
and/or one or more global entities. The specifica- 
tion of the rule is declarative, meaning that the 

50 monitoring function in Figure 3 will have to ensure 
that the actual display of the visual entity is accord- 
ing to current values for any of the global entities. 
Whenever one of the global entities that a given 
visual entity depends on changes value, the display 

55 of the visual entity will be done automatically. The 
user only specifies once what the entity should 
look like, not how to manage changes to the dis- 
play. In a preferred embodiment, global visual en- 
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tities are typically used as a display (when the type 
is window ), or as decorations in a window (for 
explaining what the visualization is all about). 

Syntactical elements 420 can be activated 
when a given object instance is created. In that 
case, the state of the instance can be extended 
with one or more extra instance variables, known 
as local variables, which will only be active in the 
context of the visualization environment. Local vari- 
ables are referred to by name and have a type, 
similar to the global visual entities in 410. When 
the type of a local instance is a one of the visual 
entities, the value of its parameters may depend on 
a combination of one or more constant values, 
and/or one or more global entities, and/or one or 
more local variables, and/or one or more instance 
variables (210) from the state of the instance (see 
220 in Figure 2). 

Syntactical elements 430 can be activated 
when a given object instance is created. In that 
case, the object instance can be represented by 
one or more visual entities or views. Elements of a 
visual type are defined by a set of one or more 
parameters. The value of these parameters may 
depend on a combination of one or more constant 
values, and/or one or more global entities, and/or 
one or more local variables, and/or one or more 
instance variables (210) from the state of the in- 
stance (see 220 in Figure 2). Whenever one or 
more of the elements on which one or more of the 
parameters depend on change value, the repre- 
sentation will be recomputed and redisplayed (see 
Figure 3). 

Syntactical elements 440 form a set of con- 
straints. Constraint-based programming is a well 
known declarative technique for limiting the domain 
of a given set of variables. In this case the con- 
straints can be defined over global variables or 
local variables. A constraint defines a relationship 
over two sets of variables. The relationship is de- 
clarative (defined once by the user and resolution 
is left to the constraint system 370, part of the 
monitoring function 300). Constraints take the form 
of two operands and one operator. The operands 
are expressions over global variables, and/or local 
variables; and/or constant values, and/or instance 
variables, and/or well known numerical operands. 
The operator is a comparison operator (such as '<', 
>=\ and * = = '). Whenever a given constraint is 
invalidated, the constraint resolver 370 will change 
one or more of the global or local variables, until 
the entire set of constraints form a valid set of 
constraints. See Figure 5 for an example of the use 
of a constraint rule 288 in a given visualization 
script 285. 

Syntactical elements 440 allow the specifica- 
tion of one or more method triggers. A method 
trigger refers to a class name, and a method name, 
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and defines what to do when hooks 260 or 270, 
executed at runtime (310), match this trigger. 
Hooks 260 and 270 mention the class name and 
the method name. When the class name of the 

5 hook matches the class name of the trigger, and 
the method name of the hook matches the method 
name of the trigger, the trigger matches the hook, 
and the corresponding action is executed. The ac- 
tion that is executed comprises assigning new val- 

w ues to global variables or local variables. In some 
preferred embodiments actions may also be the 
generation of a given tone on a audio device, or 
the activation of a sleep statement resulting in a 
delay of the visualization, or any aspect influencing 

75 the currently running visualization. 

Visualization scripts can be generated textual ty 
by a user directly, by using a well known text 
editor or word processor. Alternatively, the actual 
visualization script can be generated by a com- 

20 puter program. For instance, an interactive tool, 
which may be referred to as a visual script builder, 
may generate a script from a specification given by 
the user in the form of a drawing, or any other 
technique. The drawing would specify the rules for 

25 defining the visualization. In yet other preferred 
embodiments the script can be generated (semi- 
)automatically from knowledge inferred from, for 
instance, design information about the program. In 
the latter cases, the script will not directly function 

30 as specification language, but rather as a commu- 
nication medium between different program devel- 
opment tools. 

The following shows a sample linked list object 
class in C++. This example class is used to 

35 explain Figure 5. 
class List { 
public: 

int value; 
List "next; 

40 void SetValue(int value); 

List(List *, int); 

} 

The class List has two instance variables, an in- 
teger value and a pointer to the next element of the 

45 list next . The class List has two methods, SetValue- 
() (which will update the instance variable value ) 
and ListQ which creates an instance of the class 
List with a given value and a pointer to the next 
element in the list. 

so In our sample program, 6 instances of the 

class List are created, initialized with a random 
initial value, and linked together into a well known 
linked list datastructure. After creation, the program 
will sort the linked list, such that the values of the 

55 nodes in the linked list form a ordered collection of 
integer values. 

The following is a sample script that may be 
used to visualize the linked list when it is executed 

7 



at runtime: 

1. GLOBAL Sort Window 400 400 600 200 

2. LOCAL List x Integer 570 

3. TYPE List Box Sort x 50 9 value "black" 1 
"gray80" 

4. ENSURE List x < next.x-15 
In the example, as allowed in 410 in Figure 4, line 
1 creates a global window called Sort to display the 
visualization, locating the window at position 
(400,400), and giving it the dimensions 600 by 200 
pixels, using well known addressing techniques in 
window system technology. 

Using syntactical element 420 described in 
Figure 4, line 2 extends the state of each instance 
of the class List with a local variables used in the 
visualization. In the example, line 2 specifies an 
integer variable called x with an initial value of 
"570". This variable is added to every instance of 
the class List. 

Using syntactical element 430 described in 
Figure 4, line 3 of the example defines a box to be 
displayed in the Sort window. The horizontal posi- 
tion of the box is value of the x variable defined in 
line 2. Its vertical position is a constant "50". The 
width of the box is constant "9", and its height is 
the value of the value instance variable. The rest of 
line 3 specifies other attributes of the box such as 
the color and width of the border, and the fill color 
of the box. Line 4 applies constraints defined on 
the view. Essentially, line 4 limits the value of the x 
variable for this instance as a function of the x 
variable of the next instance. This results in the box 
for this instance being drawn at a fixed distance 
from the box for the next instance in the linked list. 

Figure 5 shows three views of the linked list. 
The top view 510 shows the visualization of the list 
during initialization of the data structure. The mid- 
dle view 520 shows a possible visualization of the 
list while the sorting algorithm is in progress. The 
lowest view 530 shows a visualization of the list 
after the algorithm has sorted it. 

Given this disclosure, one skilled in the art 
could develop other equivalent embodiments that 
are within the contemplation of the inventors. 
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ues, the values of one or more of the vari- 
ables in each object instance being a vari- 
able set defining a state of their object 
instance, each object class further having 
5 one or more methods that are a collection 

of statements that can change the state of 
an instance by changing the values in the 
variable set; 

one or more method hook data structures in- 
w serted in one or more methods of an object 

instance, the method hooks capable of gen- 
erating graphical information to be visualized 
on the graphical interface; 
a visualization script that contains one or more 
7 5 rules, the script with the rules defining a visu- 

alization on the graphical interface; and 
a monitoring function that is run when the 
method hook is executed indicating a certain 
occurrence, the monitoring function using the 
20 graphical information and the visualization 

script and rules to update the visualization on 
the graphical interface. 

2. A system, as in claim 1, where the method 
25 hooks are inserted before the method. 

3. A system, as in claim 1, where the method 
hooks are inserted before and after the meth- 
od. 

30 

4. A system, as in claim 1, where the occurrence 
is any one of an object instance being created, 
an object instance being destroyed, a method 
being entered, and a method being exited. 

. A system, as in claim 1, where the method 
hooks are inserted by a parser. 

6. A system, as in claim 5, where the method 
40 hooks are inserted after compilation. 

7. A system, as in claim 1, where the method 
hooks are inserted by an interpreter. 

45 8. A system, as in claim 1, where the visualiza- 
tion is updated to show a change of state of 
one or more object instances. 



35 



Claims 

1. A computer system for visualizing the execu- 
tion of an object-oriented program on a graphi- 
cal interface of the computer system compris- 
ing: 

a. one or more object-oriented application 
programs capable of executing on the com- 
puter system, the application programs hav- 
ing one or more object classes, each object 
class having one or more object instances, 
each object instance having one or more 
variables, the variables each having a val- 



9. A system, as in claim 1, where the visualiza- 
5 0 tion is updated in a way that satisfies one or 

more constraints. 

10. A system, as in claim 1, where the rules can 
be changed independent of the implementation 

55 and execution of the application programs. 

11. A method for visualizing the execution of ap- 
plication programs of an object-oriented sys- 
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tern, comprising the steps of: 
instrumenting one or more methods in one or 
more object classes in an application program 
of an object-oriented system with a method 
hook capable of generating graphical informa- 5 
tion to be visualized on a graphical interface; 
executing a monitoring function when the 
method hook is run, the monitoring function 
using the graphical information and a visualiza- 
tion script with one or more rules to update a 10 
visualization on the graphical interface; and 
updating the graphical interface with the 
graphical information so that the visualization 
conforms to with a current state of one or more 
object instances in the object class. is 



20 



25 



30 



35 



40 



45 



50 



55 



9 

BNSDOCID: <EP 06891 32A2_l_> 



EP 0 689 132 A2 



102 



104 < 



100 



APPLICATION 
PROGRAM 




COMPILER 



OPTIMIZER 



OPERATING SYSTEM 



114 



RAM 



1 16 



CPU 



105 
106 



MICRO INSTRUCTION CODE 




-TERMINAL 



126- 




PRINTER 



130 



134 



FIG- 1 



BNSDOCID: <EP 0689132A2_I_> 



10 



EP 0 689 132 A2 



210 



230 



210 



200 



Vf| 






►STATE 


VnJ 






M1 + + + + 
• + + + + 

Mn + + + + 



-206 
205 

-204 



PARSER 



-240 









►STATE 


VnJ 






280 



-250 



COMPILE 
& LINK 



FIG.2 




285 




\ 

N 




VISUALIZATION 


RULES 


SCRIPT 


288 



290 



EXECUTION OF OBJECT ORIENTED SYSTEM 



BNSOOCID: <EP 06891 32A2_I_> 



11 



EP 0 689 132 A2 



300 



HOOK EXECUTED AT RUNTIME 



NO 



WILL HOOK EXECUTION. 
CHANGE THE DISPLAY ? 



330 
NO 



YES 



NEED TO CREATE OR 
DELETE VISUAL REPR. ? 



340 



YES 



DO SO USE SCRIPT 



NO 



-350 



IS METHOD TRIGGER 
ACTIVATED ?? 



YES 



•360 



ACTIVATE TRIGGER 



370 



RESOLVE CONSTRAINTS 



380 



CHECK ALL VISUAL 


REPR. USE SCRIPT 




390 




REDRAW IF 






NEEDED 





- — 310 
320 

285 







END 



SEE FIG.2 




RULE 288cT| 
RULE 288b I 
RULE 288c f zo ° 
RULE 288d J 

SEE FIG. 4 



FIG.3 



395 



BNSDOCID: <EP 06891 32 A2J_> 



12 



EP 0 689 132 A2 



400 




♦ 

CREATE GLOBAL 
ENTITIES FOR 
VISUALIZATION 



1 



EXTEND STATE OF 

EACH INSTANCE 
OF A CLASS WITH 
VISUALIZATION VARIABLES 



1 



DEFINE VIEWS FOR ANY 

GIVEN CLASS TO 
VISUALIZE ITS INSTANCES 



1 



DEFINE SET OF 
CONSTRAINTS 



I 



410 



420 



430 



440 



FIG.4 



DEFINE METHOD 
TRIGGERS 



t 



450 



BNSDOCID: <EP 06891 32 A2_l_> 



13 




BNSDOCID: <EP 06891 32A2_I_> 



14 



(19) 



J 




(12) 



Europaische^^fcntamt 

European Patent Office 
Office europgen des brevets (11) EP 0 689 132 A3 

EUROPEAN PATENT APPLICATION 



\oo) uaxe ot puuiiuaiiun mo. 


(ol) Int. Ol. . vatlor y/****, OUDr 1 l/Ot, 


11.12.1996 Bulletin 1996/50 


G06F 11/00 






27.12.1995 Bulletin 1995/52 




Annliratinn nnmhpr* 07866 6 




(22) Date of filing: 23.05.1995 




(84) Designated Contracting States: 


(72) Inventors: 


DE FR GB 


* Laffra, Johannes Christiaan 




Osstning, New York 10562 (US) 


(30) Priority: 23.06.1994 US 264663 


* Malhotra, Ashok 




Croton-on-Hudson, New York 10520 (US) 


(71 ) Applicant: International Business Machines 


Corporation 


(74) Representative: SchSfer, Wolfgang, Dipl.-lng. et al 


Armonk, N.Y. 10504 (US) 


IBM Deutschland 




Informationssysteme GmbH 




Patentwesen und Urheberrecht 




70548 Stuttgart (DE) 



(54) Visualizing object-oriented software 

(57) Object-oriented system methods are automati- 
cally instrumented with method hooks that are capable 
of generating graphical information that can be visual- 
ized on a graphical interface. When a method hook is 
run, it can indicate the occurrence of: an object instance 
being created, and object instance being destroyed, an 
method being entered or a method being exited. In the 
event of one of these occurrences, the method hooks 
initiate execution of a monitoring function that uses the 
graphical information and a visualization script with 
rules to update a visualization shown on the graphical 
interface. The update will conform with the current state 
of the object instances visualized. The rules can be 
changed, to modify the visualization, without recompil- 
ing or relinking the application programs. Constraints 
also can be used by the monitoring function to modify 
the visualization. 



100 



104 < 




-TERMINAL 




-DATA 
STORAGE 




PRINTER 







130 



CO 

< 

CM 
CO 

o> 

CO 
CD 



FIG.1 



CL 
LU 



Printed by Rank Xerox (UK) Business Services 
2.13.9/3.4 



BNSDOCID: <EP 06891 32A3_I_> 



EP 0 689 132 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 95 10 7866 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



ACM SIGPLAN NOTICES, 

vol. 28, no. 10, October 1993, NEW YORK, 
NY, US, 

pages 326-337, XPO00411735 
W. DE PAUW ET AL: "Visualizing the 
Behaviour of Object-Oriented Systems" 
* page 328, right-hand column, paragraph 
- page 333, right-hand column, paragraph 



3 



Relevant 
to daun 



l-n 



loOPSLA '88 CONFERENCE PROCEEDINGS, 1 1-11 

25 - 30 September 1988, SAN DIEGO, CA, 
I US, 

pages 191-205, XP000299828 
M. F. KLEYN ET AL: "GraphTrace - 
Understanding Object-Oriented Systems 
Using Concurrently Animated Views" 
I* the whole document * 

EP-A-0 596 591 (SUN MICROSYSTEMS, INC.) 
page 5, line 24 - page 7, line 50 * 

I EP-A-0 261 853 (TEKTRONIX, INC. ) 
I* the whole document * 

I IBM TECHNICAL DISCLOSURE BULLETIN, ll-ll 
vol. 37, no. 5, May 1994, ARMONK, NY, US, 
pages 245-246, XPO02O13894 "Visual 
Debugger for C++ Object-Oriented Programs 
* the whole document * 



1-11 



1-11 



|D, A COMPUTER, 

vol. 21, no. 5, May 1988, 
pages 14-36, XP000052904 
BROWN M H: "EXPLORING ALGORITHMS USING 
I BALSA- 1 I" 

-/" 



The present search report bas been drawn up for all claims 



1-11 



CLASSIFICATION OF THE 
APPLICATION (lnt.Cl.6) 



G06F9/44 

G06F11/32 

G06F11/00 



TECHNICAL FIELDS 
SEARCHED (I0LCI.6) 



G06F 



BERLIN 



D*e at enw^Hktm of tac Kidi 



23 September 1996 



Abram, R 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if combined with another 

document of the suae category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document cited in the application 
L : document cited for other reasons 



&T member of the same patent family, corresponding 
document 



2 



BNSDOCID: <EP 06891 32A3_I_> 



t 



EP 0 689 132 A3 




J 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 95 10 7866 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (Int.Cl.6) 



D,A 



COMPUTER, 

vol. 23, no. 9, 1 September 1990, 
pages 27-38, XP000159243 
STASKO J T: "TANGO: A FRAMEWORK AND 
SYSTEM FOR ALGORITHM ANIMATION" 



1-11 



The present search report has been drawn up for all da 



TECHNICAL FIELDS 
SEARCHED (Int.Cl.e.) 



Plan «f ware* 

BERLIN 



Data mf t* aadrftoa «f the tearc* 

23 September 1996 



Abram, R 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document cited in the application 
L : document cited for other reasons 

& : member of the same patent family, corresponding 
document 



3 



BNSDOCID: <EP 06891 32 A3_L> 




THIS PAGE BLANK (uspto) 



